MINIMAL SPECTRAL FUNCTIONS OF AN ORDINARY 
DIFFERENTIAL OPERATOR 



VADIM MOGILEVSKII 

Abstract. Let l[y] be a formally selfadjoint differential expression of an even 
order on the interval [0, b) (b < oo) and let Lo be the corresponding minimal 
operator. By using the concept of a decomposing boundary triplet we consider 
the boundary problem formed by the equation l[y] — Xy = / (/ 6 Z/2[0,&)) and 
the Nevanlinna A-depending boundary conditions with constant values at the reg- 
ular endpoint 0. For such a problem we introduce the concept of the m-function, 
which in the case of selfadjoint decomposing boundary conditions coincides with 
the classical characteristic (Titchmarsh-Weyl) function. Our method allows one to 
describe all minimal spectral functions of the boundary problem, i.e., all spectral 
functions of the minimally possible dimension. We also improve (in the case of in- 
termediate deficiency indices n±(Lo) and not decomposing boundary conditions) 
the known estimate of the spectral multiplicity of the (exit space) selfadjoint ex- 
tension A D Lo. The results of the paper are obtained for expressions l[y] with 
operator valued coefficients and arbitrary (equal or unequal) deficiency indices 
n±(L ). 



1. Introduction 

The main objects of the paper are differential operators generated by a for- 
mally selfadjoint differential expression l[y] of an even order 2n on an interval 
A = [0,6} (6 < oo). We consider the expression l[y] with operator valued coeffi- 
cients and arbitrary (possibly unequal) deficiency indices, but in order to simplify 
presentation of the main results assume that 

n 

i[y] = Y.(- l ) k ^- k y {k) ) {k) + Pn y (l.i) 
fc=i 

is a scalar expression with real-valued coefficients Pk(t) (t G A) [20]. Denote by 
Lq and L(= Lq) minimal and maximal operators respectively generated by the 
expression (1.1) in the Hilbert space S) := L^A) and let T> be the domain of L. As 
is known Lq is a symmetric operator with equal deficiency indices m = u±(Lq) and 
n < m < 2n. Denote also by := m — n the defect number of the expression (1.1) 
at the point b [17]. 
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In the present paper we develop an approach based on the concept of a decom- 
posing boundary triplet for a differential operator [17, 18, 19]. Recall that ac- 
cording to [17] a decomposing boundary triplet for L is a boundary triplet II = 
{C n © C Ttb ,r ,ri} in the sense of [9] with the boundary operators Yj : V -> 
C n © C n », j G {0, 1} of the special form 

r y = {y (2) (0), Y' y} (g C n © C n »), Y iy = {-y«(0), Y[y} (g C n © C n >). (1.2) 

Here y^\0) are vectors of quasi-derivatives (2.27) at the point and Y'-y(^i C n& ), j G 
{0, 1} are vectors of boundary values of a function y G T> at the singular endpoint b. 

Next assume that V = {Co (A), C\{\)} (A G C \ R) is a Nevanlinna operator pair 
defined by the block representations 

C (A) = (C C (A)) : C" © C rib -> C m , Ci(A) = (Ci Cj(A)) : C n © C n& -> C m 

(1.3) 

with the constant entries Co, Ci and let r = r(A) := {{/i, h'} : Co(A)/i+Ci(A)/i' = 0} 
be the corresponding Nevanlinna family of linear relations. Denote by /C the range 
of the operator C = (Co C\) and let 

n = dim /C = rank (Co Ci), n' = m — n. 
Then n < n < m and the operator pair (1.3) admits the block representation 

C (A) = cf 2 {\)) : £H ^ ^ ^ ® (L4) 



d(A) 



C^a)^ :Cn ® cn ' -^^©^■ L , (1-5) 

where A/j are (n x n)-matrices with rk(iVo N±) = n and Cj 1 (A), Cj 2 (A) (j G {0, 1}) 
are respectively (n x n^) and (n' x n;,)-matrix functions. By using the boundary 
operators (1.2) consider the boundary problem 

l[y] - Ay = / (1.6) 
(*) Co(A)r o2 /-C 1 (A)r 1 y = 0. 

It follows from (1.4), (1.5) that the boundary condition (*) can be written as two 
equalities 

i\W 2) (0) + iViy (1) (0) + C 01 (A)r y - C' n (X)Y' iy = 0, (1.7) 
C 02 (A)r y-C( 2 (A)r / 1 y = 0, (1.8) 

which define in fact m linearly independent boundary conditions in the sense of [7]. 

The problem (1.6)-(1.8) is a particular case of a general Nevanlinna type bound- 
ary problem and hence it generates a generalized resolvent R(X) = -R T (A) and the 
corresponding spectral function F(t) = F T {t) of the operator Lq [19]. Moreover 
each selfadjoint boundary problem is given by the boundary condition (*) with a 
constant-valued Nevanlinna pair V = {Co,Ci}, which implies that each canonical 
resolvent of the operator Lq is generated by the boundary problem (1.6)-(1.8) with 
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C' n {X) = C' n and C' j2 (X) = C' j2 , j G {0,1}, A G C \ M. Observe also that the 
problem (1.6)-(1.8) contains as a particular case a decomposing boundary problem. 
Namely if (and only if) the equality h = n is satisfied, then C' 01 (X) = C{ 1 (A) = 
and the boundary conditions (1.7), (1.8) becomes decomposing. 

Next assume that M(-) is the Weyl function of the decomposing boundary triplet 
(1.2) in the sense of [4] and let 

M(A) = ^ ™^ m!(A)) : £H ® C " 6 ^ C " ® C " 6 ' A G C \ M (1.9) 

be the block representation of M(A). Moreover let 0(A) = f2 r (A) be the Shtraus 
characteristic matrix of the generalized resolvent R(X) = R T {X) [24]. Then f2 r (A) is 
defined immediately in terms of a Nevanlinna boundary parameter r by the equalities 

_ (M(X) - M(A)(r(A) + M{X))~ 1 M{X) -\l + M(A)(r(A) + M(A)) -1 



^ r(A) "V -^+(r(A) + M(A))- 1 M(A) " — (r(A) + M(A)) -1 

(1.10) 

n T (X) = Pc-ec- fir(A) r C n e C n , AeC\K. 
(see [19]). For a given operator pair (1.4), (1.5) consider also the operator function 

n T , w ,(x) = (w'y^rWiw'y 1 * , agc\m, (1.11) 

/—TV* *\ 

where W = ( ^® \ is an invertible (2n x 2n)-matrix (the form of the entries * 

does not matter). We show in the paper that the operator function (1.11) is of the 
form 

(It,w'W = ( jj:£eK i ->c©x; i 1 agc\m, (1.12) 

where C is a constant operator. The equality (1.12) generates the uniformly strict 
Nevanlinna operator function m-p(-), which we call an m-function of the boundary 
problem (1.6)-(1.8). This function can be also explicitly defined in terms of the 
boundary conditions (1.7), (1.8) (see Theorem 3.11, 3)). Moreover in the case of 
selfadjoint decomposing boundary conditions the function m-p(-) coincides with the 
classical characteristic (Titchmarsh-Weyl) function [20]. 

It turns out that the characteristic matrix O r (-) and the m- function m-p(-) are 
connected by 

mp(A) = N*fl T {X)N + C, C = C*, 

where N is the right inverse operator for N' = (—Nq N{). This implies that m-p(-) 
is the uniformly strict part of the Nevanlinna function f2 r (-) and the function O r (-) 
is uniformly strict if and only if m = n = 2n and the (2n x 2n)-matrix {Nq N\) is 
invertible. 

In the final part of the paper we consider some questions of the eigenfunction 
expansion. Namely let ip{t,X) = {ip\{t,X) ip2{t,X) ... tpd{t,X)) be a system of 
d = d v linearly independent solutions of the equation l\y] — Xy = with the constant 
initial data ip^{0,X) = ipj, j G {0,1}. Recall that a {d x d)-matrix distribution 
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S(s) = S TiV (s) (s £ M) is called a spectral function of the boundary problem (1.6)- 
(1.8) corresponding to the solution </?(•, A) if for each function f £ $) with compact 
support the Fourier transform 



(here F T (-) is the spectral function of Lq). As is known [7, 20, 24] in the case 
d,p = 2n there exists a unique spectral function S T)¥ ,(-) of the problem (1.6)-(1.8). 
At the same time for simplification of calculations it is important to make d v as small 
as possible [7, ch. 13.5]. Therefore the natural problem seems to be a description of 
all spectral functions S Ti¥ ,(-) with the minimally possible value of cL, (we denote this 
value by d m { n and we call the corresponding spectral function minimal). It turns 
out that the complete solution of this problem is based on the introduced concept 
of the m-function m-p(-). Namely the following theorem holds. 

Theorem 1.1. Let V = {Cq(X), Ci(A)} be a Nevanlinna pair (1.4), (1.5) and 
let (^jv(t, A) = (<fi(t, A) <f2(t, A) ... ipn(t, A)) 6e i/ie h-component linearly inde- 
pendent solution of the equation l[y] — Xy = wi/t i/ie initial data tp$(0, A) = 



i/iere exists i/ie unique (n x h)-spectral function T,-p t j\r(s) of the problem (1.6)- 
(1.8) corresponding to (Pn(-,X) and this function is calculated by means of the Stielt- 
jes formula (4.17) for the m-function m-p(-); 

2) dmin = n and the set of all minimal spectral functions S m j n (-) is given by 



where X is an invertible (n x h) -matrix. 

Moreover we show that for a fixed pair N = (Nq N±) the set of all spectral 
functions T,-p^(s) is parameterized by the Stieltjes formula (4.17) and the following 
equality 



m v {X) =T Nfi (X) + T N (X)(Co(X)-C 1 (X)M(X))- 1 C\(X)T^(X), AeC\l, (1.13) 



which is similar to the known Krein formula for resolvents (see for instance [4]). In 
formula (1.13) M(A) is the Weyl function (1.9) and T/v i o(A), T/v(A) are the matrix 
functions defined by means of M(X) and the pair N. The role of a parameter in 
(1.13) is played by a Nevanlinna pair V = {Co (A), C\ (A)} given by (1.4), (1.5) with 
fixed No, Ni and all possible C^-(A). Note in this connection that for a decomposing 
boundary problem formula (1.13) leads to similar one from our paper [16]. More- 
over (1.13) implies the known description of all Titchmarsh - Weyl functions m(-) 
obtained for quasi-regular expressions l[y] by Fulton [8] and Khol'kin [10, 22] (we 
are going to touch upon these questions elsewhere). 




satisfies the equality 




-N$, (p% ) (0,\) = N;. Then: 



^min(s) = X*Y l -p tN (s)X, 
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Finally by using Theorem 1.1 we prove the inequality sm{A) < h, where sm(A) 
is the spectral multiplicity of the (exit space) selfadjoint extension A D To given 
by the boundary conditions (1.7), (1.8). This result improves the known estimate 
sm(A) < m implied by simplicity of the operator Lq. In this connection note that 
in the case A = [0,6] one can put in (1.7), (1.8) T' y = y (2) (6), T[y = y (1) (6), 
which implies that the multiplicity of each eigenvalue of the canonical extension 
A = A* does not exceed n(= rk(Ao Aq)). Hence in the case A = [0,6] the 
estimate sm{A) < h (for the canonical extension A) is immediate from (1.7), (1.8) 
and discreteness of spectrum of A. Meanwhile, such an estimate dose not seem to 
be so obvious in the case of intermediate deficiency indices n < m < 2n and not 
decomposing boundary conditions. 

2. Preliminaries 

2.1. Notations. The following notations will be used throughout the paper: Sj, H 
denote Hilbert spaces; \H\,H2[ is the set of all bounded linear operators defined on 
Hi with values in Hi\ [H] := [H,H]; Pc is the orthogonal projector in fj onto the 
subspace C C fj; C + (C_) is the upper (lower) half-plain of the complex plain. 

Recall that a closed linear relation from Ho to Hi is a closed subspace in Ho®Hi- 
The set of all closed linear relations from Ho to Hi (from H to H) will be denoted 
by C(Ho,Hi) (C(H)). A closed linear operator T from Ho to Hi is identified with 
its graph grT G C{H Q ,Hi). 

For a relation T £ C(H ,Hi) we denote by V(T), K(T) and KerT the domain, 
range and the kernel respectively. Moreover T _1 (e C(H\,Hq)) and T*(g C{H\,Hq)) 
stands for the inverse and adjoint relations. 

In the case T G C(H ,Hi) we write: G p(T) if KerT = {0} and 1Z(T) = Hi, 
or equivalents if T^ 1 G [Hi,H ]; G p(T) if KerT = {0} and K{T) is closed. 
For a linear relation T G C(H) we denote by p{T) = {A G C : G p(T — A)} and 
p(T) = {A G C : G p(T — A)} the resolvent set and the set of regular type points 
of T respectively. 

2.2. Holomorphic operator pairs. Recall that a holomorphic operator function 
<!>(•) : C \ R — >■ [H] is called a Nevanlinna function if ImX • Im<&(\) > and 
3>*(A) = $(A), A G C \ R. Moreover the Nevanlinna function $(■) is said to be 
uniformly strict if G p(Im&(\)). 

Next assume that A is an open set in C, IC,Hq,Hi are Hilbert spaces and Cj(-) : 
A — > [Hj,K], j G {0,1} is a pair of holomorphic operator functions (briefly a 
holomorphic pair). In what follows we identify such a pair with a holomorphic 
operator function 

C(A) = (C (A) Ci(A)) :H ®Hi -+ K, A G A. (2.1) 

A pair (2.1) will be called admissible if TZ(C(X)) = K, for all A G A. In the sequel all 
pairs (2.1) are admissible unless otherwise stated. 
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Definition 2.1. Two holomorphic pairs C(-) : A -> [Ho © Hi,/C] and C'(-) : A ->■ 
[Ho © Hi, /C'] are said to be equivalent if C"(A) = <£>(A)C(A), A G A with a holomor- 
phic isomorphism ip(-) : A — >■ [JC, K'\. 

Clearly, the set of all holomorphic pairs (2.1) falls into nonintersecting classes of 
equivalent pairs. Moreover such a class can be identified with a function r(-) : A — > 
C(Ho,Hi) given for all A G A by 

r(A) = {(C (A),Ci(A));/C} := {{/i A} G ^o©Hi : Cb(A)/*)+Ci(A)/ii = 0}. (2.2) 

In what follows we suppose that Ho is a Hilbert space, 'Hi is a subspace in Ho, 
H 2 := Ho © Hi and Pj is the orthoprojector in Ho onto Hj, j G {1, 2}. With each 
linear relation 6 G C(Ho, Hi) we associate a x-adjoint linear relation 9 X G C(Ho, 'Hi) 
defined as the set of all {ko, k\} G Ho © Hi such that 

(fci, /io) - (fco, M + KPiko, P2ho) = 0, {/io, hi} G 0. 

Clearly, in the case Ho = Hi =: H the equality # x = #* is valid. 

Next assume that /Co is an auxiliary Hilbert space, K\ is a subspace in /Co and 



C(A) = (C (A) d(A)) : Ho © Hi ^ /Co, AG C+ (2.3) 

D{\) = {D (X) Di(A)) :H ffiHi -> /Ci, A G C_ (2.4) 
are holomorphic operator pairs with the block-matrix representations 

C (A) = (Coi(A) C 02 (A)) : Hi H 2 ^ /C , (2.5) 

A)(A) = (Doi(A) 73 02 (A)) : Hi ©H 2 ^ /Ci. (2.6) 



Definition 2.2. A Nevanlinna collection of holomorphic operator pairs (briefly a 
Nevanlinna collection) is a totality {C(-), D(-)} of holomorphic pairs (2.3), (2.4) 
satisfying 

2/m(Ci(A)C *i(A)) + C 02 (A)C * 2 (A) > 0, G p(C (\) - iCi(A)Pi), A G C+ (2.7) 

2/m(Z?i(A)7J * 1 (A)) + Do 2 (A)7Jo* 2 (A) < 0, G p(A)i(A) + i£>i(A)), A G C_ (2.8) 

C^D^iX) - Coi(X)Dl(X) + iCo2(X)D* 02 (X) = 0, AG C+. (2.9) 

A Nevanlinna collection (2.3), (2.4) is said to be constant if /Co = K\ =: K, and 
Cj(X) = Dj(z) = Cj, j G {0, 1} for all A G C+, z G C_. 

Clearly, a constant Nevanlinna collection can be regarded as an operator pair 

C=(C Ci):H ffiHi^/C (2.10) 

with the block-matrix representation Co = (Coi Co 2 ) : Hi © H 2 —> /C satisfying 

2/m(CiC , * 1 ) + C 02 C * 2 = 0, G p(Co — iC±Pi), G p(Coi + iC±). (2.11) 

This and Proposition 3.4 in [14] imply that the equality 

6 = {(Co, Ci); /C} := {{/i , /ii} G H © Hi : C /i + C x h x = 0} (2.12) 

define a linear relation 6* G C(Ho,Hi) such that (— #) x = —9. Moreover a constant 
Nevanlinna collection exists if and only if dim Hi = dimHo(= dim/C). 
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Definition 2.3. A collection r = {r + ,r_} of two functions t+(-) : C + — > C(Ho,H\) 
and r_(-) : C_ -)■ C(H ,Hi) is said to be of the class R(H ,Hi) if for all A G C + 
and z € C_ it admits the representation 

r+(A) = {(Co(A),C 1 (A));/C }, r_(z) = {(D (z), D 1 (z)); £1} (2.13) 

with a Nevanlinna collection |C(-),D(-)} (see (2.2)). 

A collection r = {r + , r_} G R(Hq, Hi) belongs to the class R°(Hq,Hi) if it admits 
the representation r±(A) = {(Co,Ci);/C} = 9, A G C± with a constant Nevanlinna 
collection (operator pair) (2.10). 

It follows from Definition 2.3 that a collection r = {t+,t_} G R(Ho,Hi) can be 
regarded as a collection of two equivalence classes of holomorphic pairs (2.3) and 
(2.4) satisfying (2.7)-(2.9). Moreover according to [14] 

ImA- (2/m(/ii,/i ) - ||P 2 /io|| 2 ) > 0, {ho, hi} G t±(A) (2.14) 

and — t + (A) = (— r_(A)) x , A G C + for any collection r = {t + ,t_} G R(Ho,Hi). 

Remark 2.4. l)Clearly a Nevanlinna collection (2.3), (2.4) satisfies the equalities 

dim 'Ho = dim/Coi dim "Hi = dim/Ci. (2-15) 

Therefore the representation (2.13) with K-o = K,\ =: K, is possible if and only if 
dim^i = dim Ho, in which case the corresponding Nevanlinna collection (2.3), (2.4) 
can be regarded as the unique holomorphic operator pair defined on C+ U C_. 

2) In the case Hi = Ho =: H the class R(H) := R(H, H) coincides with the 
known class of Nevanlinna functions r(-) : C \ R — >■ C(H) (see for instance [6]) and 
(2.13) takes the form 

r(A) = {(C (A),Ci(A));/C}, AgC\R, (2.16) 

where C(A) = (Co(A) Ci(A)) : H © H — > K, is a holomorphic Nevanlinna pair. 
Moreover a constant Nevanlinna pair can be identified by means of (2.10) and (2.12) 
with a selfadjoint linear relation (operator pair) 9 = 6* G C{H). 

2.3. Boundary triplet and the Weyl function. Let A be a closed densely de- 
fined symmetric operator in fj with the deficiency indices n±(A) := dim 91a (A), A G 
C±. 

Definition 2.5. [15] A collection II = {H © Hi,^,^}, where H is a Hilbert 
space, Hi is a subspace in Hq and r,- : D(v4*) — > Hj, j G {0, 1} are linear maps , is 
called a D-boundary triplet (or briefly a D-triplet) for A*, if the map T = (To Ti) T : 
D(A*) — >■ Ho © %i is surjective and the following Green's identity holds 

(A*f, g) - (f, A*g) = (Tif, T g) - (T f, T l9 ) + i(P 2 T f, P 2 T g), f,g€ V(A*) 

(here as before P 2 is the orthoprojector in Ho onto H 2 = Ho QH\). 

As was shown in [15] 

dim^i = n-(A) < n+(A) = dimH 



8 VADIM MOGILEVSKII 

for each D-triplet {Ho © %i,ro,ri}. Moreover the equalities 

V(A ) := Kerr = {/ G V(A*) : r / = 0}, A = A* \ V(A ) (2.17) 

define the maximal symmetric extension Aq of A with n^(Ao) = 0. 

It turns out that for every A G C + (z G C_) the map T f ^1\{A) (PiT \ W Z (A)) 
is an isomorphism. This makes it possible to introduce the operator functions (7- 
fields) 7+(-) : C+ -»■ [Ho, ft], 7_(-) : C_ -»■ [Hi,Sj] and the Weyl functions M+(-) : 
C+->[Ho,Hi], M_(-):C_^[Hi,H ]by 
7+ (A) = (r ^OTa(A))- 1 , AgC + ; 7 _(z) = (P^o t K Z (A)T\ z € C_, (2.18) 
ri r 9T A (v4) = M+(A)r [ 9ft A (A), A G C+, (2.19) 

(ri + iP 2 r ) r k z (a) = M_(z)pr \ m x (A), z g c_. (2.20) 

According to [15] all functions 7 ± and M± are holomorphic on their domains and 
M|.(A) = M_(A), A G C+. Moreover the block matrix representations 

M+(A) = (M(A) 7V+(A)) :H 1 ®H 2 ^H 1 , A G C+ (2.21) 

M_(z) = (M(z) iV_(z)) T ^Ui®%2i ze£- (2.22) 

generate the uniformly strict Nevanlinna function M(-) : C \ E — > ['Hi]. 

Proposition 2.6. Zei A be a densely defined symmetric operator in ft, let II = 

{Ho ©"Hi, To, Til 6e a D-triplet for A* and let M+(-) 6e i/te corresponding Weyl 
function. Then for each collection r = {t + ,t_} G R(Ho,Hi) the following equalities 
hold 

s- lim P 1 {T + (iy) + M + (iy)y 1 /y = 0, (2.23) 
s- lim (M{iy) - M + (iy)(T + {iy) + M+iiy^Miiy^/y = 0. (2.24) 

Remark 2.7. If a D-triplet II = {%o ©%i,ro,ri} satisfies the relation Ho = "Hi := 
H (*w> ^4o = -^o)' then it is a boundary triplet. More precisely this means that the 
collection II = {H,Tq,Ti\ is a boundary triplet (boundary value space) for A* in 
the sense of [9] . In this case the relations 

7 (A) = (r [ m x (A))-\ ri \ n x (A) = m(\)t \ m x (A), a g p (a ) (2.25) 

define the operator functions [4] : p(Ao) — > [H,$i] (the 7-field) and M(-) : 
p(-Ao) — * \H\ (the Weyl function) associated with the operator functions (2.18)- 
(2.20) by 7(A) = 7±(A) and M(A) = M ± (A), A G C±. Observe also that for a 
boundary triplet II Proposition 2.6 follows from the II- admissibility criterion ob- 
tained in [5, 6]. 

2.4. Differential operators. Let A = [0, b) (b < 00) be an interval on the real axis 
(in the case b < 00 the point b may or may not belong to A), let H be a separable 
Hilbert space and let 

= jZ(-l) k {(Pn-kV ik) ) {k) - Wn-ky^ f^ + (qn-kV^n + PnV, (2.26) 
fc=l 
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be a differential expression of an even order 2n with smooth enough operator- valued 
coefficients Pk('),Qk(') '■ A — > [H] such that Pk(t) = p* k {t) and G p(po(t))- Denote 
by y[ fe ](-), k = 4- 2n the quasi-derivatives of a vector- function y(-) : A — >■ i/, 
corresponding to the expression (2.26) and let T>(1) be the set of functions y(-) for 
which this expression makes sense [20, 21, 22]. With every function y G we 
associate the functions y^\-) : A -> # n , j G {1,2} and y(-) : A -> # n © # n by 
setting 

yW(t) := H n ), y^(t) := {y^- k \t)} n k=1 (G H n ), (2.27) 

W) = {y (1) (t),yW(t)}(e H n @H n ), t G A. (2.28) 

Let JC be a Hilbert space and let Y (•) : A — > [JC, i?] be an operator solution of the 
differential equation 

%] - Ay = 0. (2.29) 

With each such a solution we associate the operator-functions Y^>\-) : A — >■ [AC, -ff n ], 
i G {1, 2} and Y(-) : A -»■ [JC, # n © # n ], 

yW(t) = (Y(t) yW(t) ... y[ n - 1 i(t)) T , Y {2 \t) = (yi 2 "- 1 !^) yi 2n - 2 i(t) ... yN(t)) 

?(t) = (yW(t) y( 2 )(t)) T -.ic^H n eH n , teA, 

where Y [fc] (-), A; = + 2n - 1 are quasi-derivatives of Y(-). 

In what follows fj(= L2(A;H)) is a Hilbert space of all measurable functions 
/(•) : A -> # such that J & | |/(t)| | 2 (it < oo. Moreover L' 2 [/C,#] stands for the set of 
all operator-functions Y(-) : A — > [JC, H] such that Y(t)h G for all h G JC. 

It is known [20, 21, 22] that the expression (2.26) generates the maximal operator 
L in ft, defined on the domain V = V(L) := {y G V(l) n ft : G i}} by Ly = 
l[y], i/6D. Moreover the Lagrange's identity 

(Ly, z)si - (y, Lz)„ = [y, z](b) - [y, z](0), y,z£V (2.30) 

holds with 

[y,z](t) = {yV{t),zW{t)) Hn - (yW(t),zW(t)) H n, \y,z](b) = \un[y,z}(t). (2.31) 

tfb 

Let V = {y G V : y(0) = and [y, z](b) = 0, z G V} and let L = L \ V be the 
minimal operator generated by the expression (2.26). Then Lq is a closed densely 
defined symmetric operator in fj and Lq = L [20, 21, 22]. Moreover the deficiency 
indices n±(Lo) of the operator Lo are not necessarily equal. 

Let 9 = 6* G C(H n ) and let L# be a symmetric extension of Lq with the domain 
V(L e ) = {y G V : y(0) G 0, [y,z](6) = G P}. According to [17] deficiency 
indices n±(Lg) of an operator do not depend on 6(= 6*), which enables us to 
introduce the deficiency indices at the right endpoint b by rib± := n±(Lg). 
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2.5. Decomposing boundary triplets. Assume that Hi is a subspace in a Hilbert 
space H' , H' 2 := H' Hi, T' : V — > H' Q and r' x : V — > H[ are linear maps and Pj is 
the orthoprojector in H' onto U' p j G {1, 2}. Moreover let H = H n © H' , Hi = 
H n © Hi and let Tj : V — » Hj, j G {0, 1} be linear maps given for all y G £> by 

r y = {y (2) (0), r' y} (g H n © H ), r iy = {- y W (o), r' iy } (g h" © Hi). (2.32) 

Definition 2.8. [17] A collection II = {Ho ©Hi, To, Ti}, where To and Ti are linear 
maps (2.32), is said to be a decomposing D-boundary triplet (briefly a decomposing 
£>-triplet) for L if the map V = (r' Ti) T : V -> H © Hi is surjective and the 
following identiy holds 

[y,z}(b) = (r[y,T' z)-(T' y,T' 1 z) + i(P^' y,P^' o z), y,zeV. (2.33) 

In the case H' = Hi =: H' ( Ho = Hi =: H) a decomposing L>-triplet 

11 = {H,r ,r!} is called a decomposing boundary triplet for L. For such a triplet 
the identity (2.33) takes the form 

[y,z}(b) = (T' 1 y,r' z)-(T' y,T , iz), y,z^V. (2.34) 

As was shown in [17], Lemma 3.4 a decomposing D-triplet (a decomposing boundary 
triplet) for L is a D-triplet (a boundary triplet) in the sense of Definition 2.5 and 
Remark 2.7. Moreover a decomposing D-triplet (boundary triplet) for L exists if 
and only if < (respectively, = n^), in which case 

dim Hi = < = dimH , dimHi = n_(L ) < n + (L ) = dim Ho (2.35) 

(respectively, = = dimH' and n_(Lo) = n + (Lo) = dimH). Therefore in 
the sequel we suppose (without loss of generality) that ri{,_ < and, consequently, 
n-{L ) < n + (L ). 

Proposition 2.9. [17] Let {Ho © Hi, To, Ti} be a decomposing D-triplet (2.32) for 
L and let 7±(-) be the corresponding ^-fields (2.18). Then: 

1) For each A G C + (z G C_) there exists a unique operator function Z + (-, A) G 
L' 2 [Ho,H] (Z-(-,z) G L^fHi,^]), satisfying (2.29) and the boundary condition 
T (Z + (t,X)h ) = h , h G Ho (resp. PiT (Z_(t, z)hi) = h u hi G Hi). If 

Z + (t,X) = (v {t,X) u+(t,\)) :H n ®H'o^H, A G C+, (2.36) 

Z-(t,z) = (v (t,z) u-(t,z)) :H"ffiHi ^ H, z G C_ (2.37) 

are the block representations of Z + (-,A) and Z-(-,z), then the above boundary con- 
dition can be represented as 

v { 2) (0,fi) = I Hn ( M eC\R); r (w (t, A)/i) = 0, P{F' o {v o (t,z)h) = 0, h G H n 

*i 2) (0,A) = 0; r{,(« + (*,AK) = ^, AGC+, fo G H ; 

uL 2) (0,z) = 0, P[r{,(«_(t,«)/ii) = h[, z G C_, h\ G Hi. 

2) /or all A G C+ and z G C_ i/ie following equalities hold 

( 1+ (X)h ){t) = Z+(t,X)h , h G Ho {-y-(z)hi)(t) = Z-(t,z)h u hi G Hi- (2.38) 
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Next assume that M±(-) are the Weyl functions (2.19), (2.20) corresponding to 
the .D-triplet II and let 

M+(A) =Gwi) J£$J) 'a***!-*-**.. *€C t (2.39) 

be their block representations. As was proved in [17, Theorem 3.12] all the entries 
in (2.19) and (2.20) can be defined immediately in terms of boundary values of the 
functions vo(-, A) and u±(-, A). In particular formulas (2.39) and (2.40) generate the 

uniformly strict Nevanlinna function m(X) = — v^(0, A), which we called in [17] the 
m-function. 

2.6. Generalized resolvents and characteristic matrices. Let A D Lq he an 

exit space selfadjoint extension of the operator Lq acting in the Hilbert space S) D S) 
and let E(t) be the orthogonal spectral function of the operator A. Recall that the 
operator functions 12(A) = P^{A - A)" 1 ^, A G C \ M and F(t) = P^E{t)\9) are 
called generalized resolvent and spectral function of the operator Lq respectively. In 
the sequel we suppose that the spectral function E(t) (or equivalently the extension 
A) is minimal, which means that spanjij, E(t)$j : t G M} = $). 

Let Y (-,X) : A ->• [H n © H n ,H] be the "canonical" operator solution of the 
equation (2.29) with the initial data Yq(0, A) = lH n ®H n and let 

J H „ : = ^ ~^ n ^ :H n eH n ^H n (B H n . (2.41) 

According to [24, 3] the generalized resolvent R(\) admits the representation 

(R(X)f)(x) = I G(x, t, X)f(t) dt := lim / G(x, t, X)f(t) dt, f = /(•) G Sj (2.42) 

Vtb o 

with the Green function G(-, ',A):AxA-> [H\ given by 

G(x,t,\) =Y (x,\)(n(\) + ±sgn(t-x)J H ™)Y *(t,\), AgC\R. (2.43) 

Here J1(A)(G [H n © H n ]) is a Nevanlinna operator function, which is called a char- 
acteristic matrix of the generalized resolvent R{\) [24]. 

Next assume that LT = {%$ ©"Hi, To, Til is a decomposing .D-triplet (2.32) for L 
and r = {t + ,t_} G R(T-Lo,7ii) is a collection of holomorphic pairs (2.13) with the 
block representations 

Cb(A) = (Cb(A) C (A)) : tf" © H' -> /Co, (2.44) 

Ci(A) = (Ci(A) C((A)) : £P © H[ -)• /Co, A G C+ 

£>o(A) = (-Do (A) D> (A)) : F l © ft -> /C 1; (2.45) 

^(A) = (-Di(A) D[(X)) : H n © H[ ->■ /Ci, A G C_ 
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For a given function / G Sj consider the boundary value problem 

l[y] -Xy = f (2.46) 
C o (X)y ( - 2 \0) + C 1 (X)y^(0) + C^X)T' oy -C[(X)T' 1 y = 0, A G C+ (2.47) 
D Q (X)y( 2 \0) + D 1 (X)y( 1 \0) + D' (X)T' y - D'^X^y = 0, A G C_. (2.48) 

In view of (2.44) and (2.45) the conditions (2.47) and (2.48) can be written as 

C (X)T o y-C 1 (\)T 1 y = 0, AGC+; D {X)T y - Di(A)r l2/ = 0, A G C_. (2.49) 

A function y(-, •) : A x (C \ R) — > H is called a solution of the boundary problem 
(2.46)-(2.48) if for each A G C \ R the function y(-, A) belongs to V and satisfies the 
equation (2.46) and the boundary conditions (2.47), (2.48). 

Theorem 2.10. [19] Let r = {t+,t_} G R{Hq,%\) be a collection given by (2.13) 
and (2.44), (2.45) and let Cl T+ (X) an d ^t-(A) be the operator function defined by 

fi T+ (A) = f~ 1+ ^J ~ 2+ ?!WoffiWi^«i©^, AGC+, (2.50) 

wi+(A) = M+(A) - M+(A)(r+(A) + M+(A))- X M+(A) (2.51) 
S 2+ (A) = -\l Ul + M+(A)(r+(A) + M + (A))- X (2.52) 
S 3+ (A) = -i/ Ho + (r+(A) + M + (A))- 1 M + (A) (2.53) 
5 4+ (A) = -(r+(A) + M + (A))- 1 , (2.54) 
h T _(X) = (n T+ (X))*, AgC_. (2.55) 

T/ien: 

1 ) for each f G S) the boundary problem (2.46) -(2.48) has the unique solution 
y(t, A) = yf(t, A) and the equality (R(X)f)(t) = yj(t, A), / G S), A G C \ R defines a 
generalized resolvent R(X) := R T (X) of the minimal operator Lq; 

2) the characteristic matrix of the generalized resolvent R T (X) is 

n(X) = fi T (A) := Ptf»eff» ^r+(A) \H n ®H n , AG C+. (2.56) 

Conversely for each generalized resolvent R{X) there exists the unique r G -R(%o> %i) 
such that R(X) = R T (X). Moreover R T (X) is a canonical resolvent if and only if 
t G RP{Ho,Hi). 

Proposition 2.11. Assume that r = {t + ,t_} G R(7io,7ii) ia a collection given by 
(2.44) and (2.45), 5i(A)(G [Wi,/C_]) ond5 (A)(€ [H ,/C_]) are denned oy 

5i(A):=D (A) tWi, 5 (A) = J Di(A)Pi+i J D (A)P 2 , A G C_, (2.57) 

and Dqi(X), Do2(A) are entries of the block representation (2.6). Moreover let 
7r(A)(e [-ff n © i7 n ,fj]) and 5(A) (G [/C_ , H n © # n ] ) 6e operator functions given by 
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the block matrix representations 

7.(A) = 7+ (A)(Co(A)-C 1 (A)M + (A))- 1 (-C'o(A) : C\(A)), A G C+ (2.58) 

5(A) = (" jP ^- (A) )(5 1 (A)-5 (A)M_(A))- 1 , AgC_. (2.59) 

Then the corresponding characteristic matrix $7 T (-) satisfies the identity 
fi T ( M ) - n;(A) = (m - A) 7 *(A) 7r (/x) - 5(A)(£)i(A)DSi(/Z) - D 01 (X)D* 1 (jl)+ (2.60) 
+iDo2(A)DS2(7Z))5*(7Z), n, A G C+. 
Moreover the following equality holds 

s - lim n T (iy)/y = (2.61) 

Proof. The identity (2.60) was proved in [19]. To prove (2.61) assume that 

n T (\)=( Ul ^\ ^J\:H n ®H n ^H n @H n , AGC\R (2.62) 
\U3z(X) W4(A)y 

is the block matrix representation of Q T (X). Then by (2.51) and (2.54) 

wi(A) = iv(S5i+(A) r«i) r# n = 

P // n(M(A)-M+(A)(r+(A)+M + (A))- 1 M(A)) [ iT\ 
w 4 (A) = PHn(PiW4+(A)) [ F n = -P if n(P 1 ( T+ (A) + M+(A))- 1 ) [ F n , AG C+, 
which in view of (2.23) and (2.24) gives 

s — lim uj\(iy)/y = s — lim wAiy)ly = 0. 

j/— >oo y— >oo 

This and the representation (2.62) proves the equality (2.61). □ 

Remark 2.12. It follows from Theorem 2.10 that the boundary problem (2.46)-(2.48) 
gives a parameterization of all generalized resolvents P(A) = P T (A) and character- 
istic matrices 0(A) = fi r (A) by means of the Nevanlinna boundary parameter r. 
Moreover since a spectral function F(t) is uniquely defined by the corresponding 
generalized resolvent R(X), one obtains the parameterization F(t) = F T (t) of all 
spectral functions of the operator Lq by means of the same boundary parameter r. 

3. TO-FUNCTIONS AND CHARACTERISTIC MATRICES 

3.1. Quasi-constant and iV-triangular Nevanlinna collections. Let II = {Ho® 
Hi,F , Ti} be a decomposing D-triplet (2.32) for L (with Hj = H n ®n' p j G {0, 1}). 
A Nevanlinna collection {C(-), D(-)} defined by (2.3), (2.4) and the block repre- 
sentations (2.44), (2.45) will be called quasi-constant if Cj(X) = Dj(z) = Cj(& 
[H n , /Ci]), j G {0, 1} for all A G C + and z G C_ (such a definition is correct, since 
/Ci C /Co). Clearly, each constant pair 6(= 6*) = {(Co, C\); K.} is quasi-constant. 
Next assume that 

N = (N iVi) :H n ®H n ^t (3.1) 
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is an admissible operator pair (that is 1Z(N) = fC) and let On G C(H n ) be a lin- 
ear relation given by On = {(Ao, N±); /C}. The operator pair (3.1) will be called 
symmetric (selfadjoint) if the linear relation On is symmetric (selfadjoint). 

Definition 3.1. A Nevanlinna collection {C(-), £>(•)} defined by (2.3), (2.4) will be 
called A-triangular if there exist a Hilbert space /C and a subspace K[ C )C' such 
that K, j = /C ® JC'j, j G {0, 1} and the following block representations hold 



c °( x )-{o C 02 (A) 

Ci(A) = 



Ni C' n (X) 
C' 12 (X) 





5^o- 


>/C3 


3 /Cq, 


A G C+ 


(3.2) 




5 Hi - 


>/C3 


3 /C , 


A G C+ 


(3.3) 




B«o- 


-»■ /C( 


B/Ci, 


A G C_ 


(3.4) 




B Ti'i - 




B/Ci, 


A G C_ 


(3.5) 



A constant A-triangular collection can be regarded as an operator pair 

C = (C Ci) : (H n © H ) © © ^ /C © /C' (3.6) 
defined by the block matrix representations 

C = ^ : H n ®n' ^ tejC, Ci = f^ 1 ^ : n © 7i[ -> /CffiT 

02/ ^ V 12/ — v; 

(3.7) 

and satisfying the relations (2.11). 

Assume now that {C(-), £)(■)} is a quasi-constant Nevanlinna collection defined 
by (2.3), (2.4) and (2.44), (2.45) and let £(c /Ci) be the range of the operator 

C := C(A) \H n ®H n = (C Ci) : H n ® H n ^ Id. (3.8) 

It is clear that the collection {C(-), !)(•)} is A-triangular with some A if and only 
if /C is closed, in which case Nj = C,(G [H n ,K.]), j G {0, 1} (here Cj is considered 
as acting from H n to K). In this connection the following proposition holds. 

Proposition 3.2. < oo (in particular, dim if < oo), then each quasi- constant 

Nevanlinna collection is N -triangular. 

Proof. Since the operator pair (2.3) is admissible, it follows that 1Z(C(X)) = /Co and, 
therefore, the range of the operator C*(A) is a closed subspace in Hq^BHi. Moreover 
by (3.8) C* = Ph*@H"C*(\) and, consequently, 

K(C*) = P H wH(C*(\)). (3.9) 

Since in view of (2.35) codim (H n ®H n ) = dim(H ©Hi) < oo, it follows from (3.9) 
that K(C*) is a closed subspace in H n © H n . This implies that t{= 11(C)) is also 
closed. □ 
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Remark 3.3. In the case = oo(44> dim%g = oo) one can easy construct a quasi- 
constant (and even constant) Nevanlinna collection {C(-), D(-)} with not closed 
subspace /C, which implies that this collection is not iV-triangular with any N. 
Hence the condition < oo in Proposition 3.2 is essential. 

Two iV-triangular Nevanlinna collections {C(-), D(-)} and {C(-), £)(■)} (with the 
same N) are said to be equivalent if the operator pairs C(-) and C(-) as well as D(-) 
and D(-) are equivalent in the sense of Definition 2.1. It is clear that for a given 
operator pair N (see (3.1)) the set of all iV-triangular Nevanlinna collections falls 
into nonintersecting equivalence classes. In what follows the set of all such classes 
will be denoted by TR{H ,Hi}. Moreover we will denote by V = {C(-), £>(•)} both 
an iV-triangular Nevanlinna collection and the corresponding equivalence class. 

Definition 3.4. A collection (the corresponding equivalence class) V = {C(-), D (•)} € 
TR{Ho,l-Li} is said to belong to the class TR°{Tio,'Hi} if it admits the representa- 
tion (3.6), (3.7) as a constant iV-triangular collection. 

In the sequel we write V = {Cq,C\} € TR°{'Hq,'Hi} identifying the collection 
V £ TR°{T-Lq, Hi} and the corresponding operator pair (3.6), (3.7). 

In the case Hq = Hi =: % (i.e., in the case of a decomposing boundary triplet 
n = {^,r ,r!}) we let TR(H) :=TR(H,H) and TR°(H) :=TR°(H,H). 

Proposition 3.5. Assume that N = (Nq N\) is an operator pair (3.1) and 
{C(-), £>(•)} G TRiHo^i} is a collection (3.2)-(3.5). Then the pair N is sym- 
metric and 

ndimH < dim/C < n_(L ); (3.10) 

Proof. Let r±(A) be linear relations (2.13). Then in view of (3.2)-(3.5) On = 
r±(A) fl (H n © H n ), A € C± and (2.14) shows that On is a symmetric linear re- 
lation. Therefore dim if™ < codim#jv = dim^C, which together with (2.15) and the 
second relation in (2.35) gives (3.10). □ 

3.2. Generalized resolvents and the Green function. Let II = {Hq^T-Ii, To, Ti} 
be a decomposing D-triplet (2.32) for L and let V = {C(-), -£>(■)} € TR{H ,Hi} 
be a collection (3.2)-(3.5). Then the corresponding boundary problem (2.46)-(2.48) 



can be written as 

l[y] - Ay = / (3.11) 

iVoy {2) (0) + N iy W(0) + C' 01 (X)T' y - C( 1 (A)r' 1 y = 0, (3.12) 

CUWoV ~ C( 2 (A)riy = 0, AG C+; (3.13) 

iV y (2) (0) + My (1) (0) + ^!(A)r^ - £ ) n(A)r / 1 y = 0, (3.14) 

^ 2 (A)r[,y- J D / 12 (A)riy = 0, A € C_. (3.15) 
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Moreover in the case V = {C ,Ci} G TR {H , Ui] (see (3.6) and (3.7)) the bound- 
ary conditions (3.12)-(3.15) take the form 

iV o2 / 2 )(0) + N iy W(0) + C' m T' y - C' u r' iy = (3.16) 

C' 02 r' y - C' 12 r' iy = (3.17) 

The following corollary is immediate from Theorem 2.10. 

Corollary 3.6. Letli = {T-Lq © "Hi, Tq, Ti} be a decomposing D-triplet (2.32) for L 
and let V = {C(-), D(-)} G TR^Hq^T-Li} be a collection given by (3.2)-(3.5). Then 
the boundary problem (3.11)-(3.15) generates the generalized resolvent R(\) = -R-p(A) 
of the operator Lq (in the same way as in Theorem 2.10). Moreover R(X) is a 
canonical resolvent if and only ifV G TR°{Ho,Hi}, in which case the corresponding 
boundary conditions can be defined by (3.16) and (3.17). 

Remark 3.7. Note that in view of Corollary 3.6 the generalized resolvent R(X) = 
R v {\) can be also defined by R P (X) = (A(X) — A) -1 , A G C \ R where A(X) = 
L \ V{A(X)) and V{A(X)) is the set of all functions y G V satisfying the boundary 
conditions (3.12)-(3.15) or, equivalently, (2.49). 

^ Assume that V = {C(-)> £>(•)} G TR{Hq,Ui\ is a collection (3.2)-(3.5) and let 
£>i(A)(G [«i,/Ci]) and D (X)(e [H ,^i]) be defined by 

D 1 {\) := D (X) \ Hi, D (X) = D 1 (X)P 1 + iD (X)P 2 , X G C_. 

It follows from (3.4) and (3.5) that the following block representations hold 

Di(X) = g~ : H n © ^ /C © /C' 1; A G C_ 

Proposition 3.8. Let the conditions of Corollary 3.6 be satisfied. Then: 

1) for each X G C \ R there exists the unique operator function v(-, A) G L' 2 [1C, H] 
satisfying the equation l[y] — Xy = and the boundary conditions 

(N v^(0, A) + iVi«W(0, X))h + (C^(A)r(, - C^riX^t, X)h) = h (3.18) 

(Co 2 (A)r -C 12 (A)r / 1 )(t;(t,A)/ l ) = 0, he It, AGC+; (3.19) 

(i\W 2) (0, A) + N lV W(0, X))ti + (D^(A)r{, - -D'n(A)r / 1 )(v(t, A)/t) = A (3.20) 

( J D 02 (A)r - J Di 2 (A)r' 1 )(«(t,A)/ l ) = 0, kiC, AgC_. (3.21) 

2) The functions v(-, X) and Z±(-, A) (see (2.36) and (2.37) ^ are connected by 

v(t x)= {z + (t^)(Co(X)-C 1 (X)M + (X))- 1 \K, A G C + 
l ' j \z_(t,A)( J D 1 (A)- J D (A)M_(A))- 1 f/C, A G <C_, 

where M±(-) are the Weyl functions (2.39) and (2.40) /or h. 
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3) for each X G C+ (resp. A G C_J i/ie equality y{t) = v(t,X)h gives a bijective 
correspondence between all h G /C and a// solutions y(-) of the equation (2.29), which 
belong to S) and satisfy the boundary condition (3.13) (resp. (3.15),). Therefore the 
operator function v-p(-, X) is a fundamental solution of the boundary problems (2.29), 
(3.13) for A G C+ and (2.29), (3.15) for A G C-(see [18, 22];. 

Proof. l)-2) It follows from (2.32) and (3.2)-(3.5) that the conditions (3.18)-(3.21) 
are equivalent to 

(c (A)r - Ci(A)ri)(v(t, A)A) = h, /t g k, a g c+ (3.23) 

(D (X)T -D 1 (X)T 1 )(v(t,X)h) = h, he)C, AGC_. (3.24) 

As was shown in [19] G p(C (X) - Ci(A)M+(A)), G p(D\(X) - 5 (A)M_(A)) and 

(C (A)r - Ci(A)ri)(Z+(t, A)/i) = (C (A) - Ci(A)M+(A))/i, /» G H , X G C+ 

(3.25) 

(Do(A)r - Di(A)ri)(Z_(t, A)/i) = (-Di(A) - 5 (A)M_(A))/i, /t G "Hi, AG C_. 

(3.26) 

Hence the equality (3.22) correctly defines the function v(-,X) G L' 2 [)C,H] satisfying 
(3.23), (3.24) and consequently (3.18)-(3.21). The uniqueness of such a function 
follows from the inclusion A G p(A(X)), where A(X) is defined in Remark 3.7. 

3) If h G /C, then by the statement 1) the function y(t) = v(t,X)h satisfies the 
equation (2.29) and the conditions (3.13), (3.15). Conversely let A G C+ and a 
function y G V satisfies (2.29) and (3.13). Then there exists h = {h, h'} G /C © K! 
such that y = Z+(t, A)(C (A) - C 1 (X)M + (X))- 1 h and by (3.25) one has (C (A)r - 
Ci(A)ri)y = h. Therefore in view of (3.13) h' = 0, so that h = h G K and by (3.22) 
y = v(t,X)h. Similarly by using (3.26) one proves the same statement in the case 
AgC_. □ 

Remark 3.9. One can easily verify that for a given operator pair TV = (Nq N±) the 
operator function v(-, A) is uniquely defined by the equivalence class V G TR{Hq, Hi}, 
i.e., v(-,X) does not depend on the choice of an A^-triangular Nevanlinna collec- 
tion (3.2)-(3.5) inside the equivalence class. To emphasize this fact we will write 

V(;X) = V V {-,X). 

Theorem 3.10. Assume that H = {T~Lq ® T-Li,Vq,T\\ is a decomposing D-triplet 
(2.32) forL, V = {C(-),D(-)} G Ti^o^i} is a collection (3.2)-(3.5) andip N (-,X) : 
A — > [}C, H], X G C is the operator solution of (2.29) with the initial data 

^(0,X) = -N*, <pP(0,\) = NZ, AgC. (3.27) 

Then the generalized resolvent R(X) = Rp(X) generated by the boundary problem 
(3.11)-(3.15) admits the representation (2.42) with the Green function G(x,t,X) = 
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G-p(x, t, A) given by 

GH X ,t,X) = H^ X) ^ { ^ X>t , AeC\K. (3.28) 
[_<Pn(x, *)Vp(t, A), x<t 

Proof. Let r = {r + ,r_} G R^Hq,T-L\) be a collection given by (2.13) and (2.44), 
(2.45), and let *+(-,A) : A -> [/Ci,#], A G C+, and F_(-,z) : A -> [/C ,i?], z € C_, 
be the operator solutions of the equation (2.29) with the initial data 

Y + (0,X) = (-D* (X) £>*(A)) T , y_(0,z) = (-C *(z) C?(2)) T . (3.29) 

Assume also that Z + (-,A) G L' 2 [/Co,-ff] and Z-(-,z) G L^/Ci,^] are given by 

Z+(t, A) = Z+(t, A)(C (A) - C 1 (A)M+(A))- 1 , A G C + (3.30) 
Z_(*,z) = Z_(t,z)(5i(z)-5o(2)M_(«)) _1 , zeC_ (3.31) 

and let 

w , - J y+(t ' A) ' A G C + ^ - l Z +^ A G C + 

r(t ' A) -\y_(t,A), AGC_ ' Z( '' A) -\z_(t,A), AgC_ • 

Then according to Theorem 14 in [19] the Green function in (2.42) is 

G(x,t,X) = l Z (xA)Y*(t,X), x>t 
V ' ; [Y{x,X)Z*(t,X), x<t ' V K ' 

Next, in the case of the block representations (3.2)-(3.5) one has 

Cj(X) = (Nj 0) T G [H n ,IC(BlC' ], Dj(X) = (Nj 0) T G [H n , K © K[], j G {0,1}. 

~ f —N* oA 

Therefore the initial data (3.29) can be written in the form Y+(0, A) = ( ^® \ G 

~ f—N* 0\ 

[K © IC[,H n © H n ], y_(0, z) = ( ^ JjJ G [/C © H n © tf"], which in view of 

(3.27) gives the block representations 

Y + (t,X) = (ip N (t,X) 0) : K © /Ci -> y_(t,z) = (<M*>*) 0) : /C © £[, -)■ tf. 

(3.33) 

Moreover by (3.22) the operator functions (3.30) have the block representations 

Z + (t,X) = (v v (t,X) «+(*,A)), -Z_(t,z) = MM) «+(*,*)) (3-34) 

with some operator functions u+(t, A) and u-(t, z). Now combining (3.33) and (3.34) 
with (3.32) we arrive at the equality (3.28). □ 
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3.3. m-functions. Let H = {Ho © To, Ti} be a decomposing D-triplet (2.32) 
for L and let N = (Nq Ni) be an admissible operator pair (3.1). Since 7Z(N) = K., 
it follows that KeriV* = {0} and 1Z(N*) is a closed subspace in H n ®H n . Therefore 
there exists a Hilbert space K, 1 - and operators Tj G [H™,^], j G {0, 1}, such that 
the operator 

(—AT* — T*\ 
^° jt J : K © K, L -> H n © H n (3.35) 

is an isomorphism. 

Next assume that W' is an isomorphism (3.35) and let Yw'(-, A)(€ [/C ffi/C-^ff]) 
be the operator solution of the equation (2.29) such that 1%'(0, A) = W. Then 

yV/(t,A) = (<p N (t,\) <pr(t,\)) :£©*> ->H, AgC, (3.36) 

where <^t(-j A) : A — >■ [/Cr 1 ,.??] is the operator solution of (2.29) given by (3.27) with 
T in place of N. Introduce also the operator J w , = (W')' 1 J H ^(W')~ u (e [/Cffi/C- 1 ]) 
where Ju n is the operator (2.41). Since J w = —Jw 1 -, the operator J7jy has the 
block representation 

Jw = (j 2 ^t®t L (3.37) 

with J7i = -J{ and J 4 = -J£. 

Theorem 3.11. Assume that the following assumptions (a) are satisfied: 

(a) IT = {Hoffi%i,r ,ri} is a decomposing D-triplet (2.32) for L, N = (N Ni) 

is an operator pair (3.1), V = {C(-), D(-)} G TR{Hq,T-Li\ is a collection of holo- 

morphic pairs (3.2)-(3.5), r = {t+,t_} G R{J-Lq,%i) is the corresponding collection 

(2.13) and fi r (0 * s the characteristic matrix (2.56). 

Moreover, let W be an isomorphism (3.35) and let Q, Tj w'(-) : C \ R — >■ [AC © K,^} 

be the operator function given by 

Q TtW ,(\) = (W'y^riXXW)- 1 * , A G C \ R. (3.38) 
Then: 1) The Green function (3.28) admits the representation 

G v {x,t,X) = Y w >{x, \)(n TjW ,(\) + \sign(t - x)Jw))Yfo,(t,\); (3.39) 
2) The operator function (3.38) has the block representation 

tt TjW ,(\) = (™^ij 2 ~^ 2 *) : A: © /C x ^ /C © /C^, A G C \ M; (3.40) 

3) The equality (3.40) generates the holomorphic operator function m-p(-) : C\R — > 
[K] which can be also defined by the following statement: 

(i) there exists a unique operator function m-p(-) : C\R — >■ [K] such that for every 
A G C \ R i/te operator function 

v(t, A) := ^(t, A)(mp(A) - 3^1) - ¥>r(*> A)J" 2 (3.41) 

belongs to L' 2 [K,,H] and satisfies the boundary conditions (3.18)-(3.21). 
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Proof. 1) The representation (3.39) is immediate from (2.43) and the obvious equal- 
ity Y (t, A) = Y w ,(t, A) (W')-\ A G C. 

2) Let v-p(-,\) be the operator function defined in Proposition 3.8 and let 

u(x, A) = (vp(x, A) 0) : K t 1 - -»• #, A G C \ R. 
Comparing (3.28) with (3.39) one obtains 

u(x,A)y^^tJ) = F^(x,A)(O T) ^(A)-ij w ,0^(^A) ! (3-42) 
for all A G C \ R. Since G p(Y w >(t,X)), it follows from (3.42) that 

u(x,X) = Y w ,(x,\)(n T!W ,(\) - \J W ,), xGA, AeC\l. (3.43) 
Next assume that the block representation of the operator function Q Tj \y/(X) is 

n TtW ,(\)= ( ^ ( A) S ( A)) ! ^ ® ^ ^ ® ^ ' A G C \ M - ( 3 - 44 ) 
Then the equality (3.43) can be written as 

Mx, A) o) = (M.,A) M..A))(^:|g Sw-Ia)' 

which implies the relations 

vp{x, A) = <p N (x, A)(m P (A) - ± Ji) + ^(x, A)(J2 2 (A) - ± J" 2 ) (3.45) 
n 3 (A) + o- J" 2 * = 0, fi 4 (A) - | J 4 = 0, AgC\R. (3.46) 

Since Sl T (\) = fi*(A), it follows from (3.38) that [) r , r (A) = ft* ^(A) and by (3.44) 

one has f2 2 (A) = ^3 (A), $74(A) = f2|(A). Combining these relations with (3.46) and 
taking the equality J± = — J% into account one obtains 

f2 3 (A) = -± J" 2 *, n 2 (A) = -5 J2, ^ 4 (A) = 0, A G C \ R. (3.47) 

Therefore the block matrix representation (3.44) takes the form(3.40). 

3) In view of (3.45) and the second equality in (3.47) the function v(-, A) = v-p(-, A) 
admits the representation (3.41). This and Proposition 3.8 give the statement 3). □ 

Definition 3.12. The operator function m-p(-) introduced in Theorem 3.11 will be 
called an m-function corresponding to the collection V G TR{7-Lo,1-Li} or, equiva- 
lently, to the boundary value problem (3.11)-(3.15). 

The m-function m-p(-) will be called canonical if V G TR°{T-Lq,%-\} or, equiva- 
lently, if it corresponds to the canonical boundary problem (3.11), (3.16), (3.17). 

Remark 3.13. Let under the conditions of Theorem 3.11 W' and W' be different 
isomorphisms (3.35) (with the same first column), let J7 Ti w(-) and r^^,(-) be the 
corresponding functions (3.38) and let m-p(X) and fh-p(X) be upper left entries in the 
representations (3.40). One can easily verify that m-p(A) = m-p(X) + C, C = C*, 
which implies that the m-function m-p(-) is defined by a collection V G TR{T-Lo,T~Li} 
up to the selfadjoint constant. 
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For a given operator pair (3.1) introduce the operator N' G [H n © H n , K] and the 
subspaces 9 and 9 1 - in H n © H n by 

N' = (-N Ni) : H n ®H n -> £, 6' ± =KeriV', 9 = (H n ® H n ) Q 9 ± . (3.48) 

Clearly, the operator iVg := N' \ 9 isomorphically maps 6* onto /C and the operator 

N:=(N^)-\ N G [!C,H n (BH n ]) (3.49) 

is the right inverse for N', that is N'N = 1^. Assume also that 

N = (N iVi) T : t -> # n © # n (3.50) 

is the block matrix representation of the operator N. 

Proposition 3.14. Let the assumptions (a) of Theorem 3.11 be satisfied and let 
a(A)(G [/C_,£]), A G C_ be a linear fractional transformation of the Weyl function 
M_(A) given by 

a(A) = (^Pflt, - iV *PHnM_(A))(5 1 (A) - £> (A)M_(A)) -1 , A G C_. (3.51) 

Then: 1) the m-function m-p(-) is a uniformly strict Nevanlinna function satisfying 
the relations 

m v {v)-m* v {\) = {ix-\))v* v (t,\)v v (t,ix)dt - a[X)(D l (X)D* 01 (jl)- (3.52) 

o 

-D 01 (X)DI(J1) + iD 02 (X)D* 02 (Ti))a*(ji), fi, A G C + 

, b 

(ImXy 1 ■Im(m P (X))> fv?p(t,\)vp(t,\)dt, A G C+. (3.53) 

o 

Here Dqi(-) and D 02 (-) are taken from (2.6) and the integral converges strongly, that 
is 

b r\ 

/ Vp(t, X)vp(t, n)dt = s — lim / vi(t, X)vp(t, fx) dt. 
o vfb o 

For the canonical m-function m-p(-) the identity (3.52) takes the form 

m v (fj,)-m?p{X) = (LL-X)fvv(t,X)v-p(t,fj,)dt, n,XeC\R (3.54) 

o 

and the inequality (3.53) turns into the equality. 

2) The characteristic matrix f2 T (-) admits the representation 

n T (X)=( n °^ ™£j :9®9 ± -^9®9 ± , AGC\M, (3.55) 

where Q 2 = ^2 e I^ - * - ] anc ^ ^o(") : C \ R — > [9] is a uniformly strict Nevanlinna 
function associated with m-p(-) by 

n (A) = A#* m v {X)N' Q + C, C = C* e[9}. (3.56) 

Moreover the following equality holds 

m v (X) = N*n T (X)N + C, C = C*e[K,\, X G C \ R. (3.57) 
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Proof. Let W' be an isomorphism (3.35) and let £l Tj \y(X) be the operator function 
(3.38). Then T (A) = W'Q Tt w'(tyW* and the immediate calculation with taking 
(3.40) into account shows that 

n T {\) = N'*m v {X)N' + C (3.58) 

with some C = C* G [H n H n \. Multiplying the equality (3.58) by N* from the 
left and by N from the right one obtains (3.57). Therefore m-p(-) is a Nevanlinna 
function. 

In view of (3.57) and (2.60) 

mrifi) - m* P (X) = (v-XKiXhciti-aWiDiWD^iJl)- (3.59) 

-D 01 (X)Dl(j2) + iD 02 (X)D* 02 (jl))a*(jl), A G C+, 

where 

7c (A) = 7r (A)A>, A G C+; q(A) = N*a(X), A G C_ (3.60) 
and 7 T (-) and 5(-) are the operator functions (2.58) and (2.59) respectively. Moreover 
by (3.59) and the inequality in (2.8) one has 

(ImX)- 1 ■Im{m v (X)) > 7c *(A) 7c (A), A G C+, (3.61) 

It follows from (3.2) and (3.3) that for all A G C+ the operator (— Co(A) : C±(X)) in 
(2.58) coincides with N'. This and the equality N'N = 1^ imply that 

7c (A) = 7+ (A)(Co(A)-C 1 (A)M + (A))- 1 \ K, X G C+. (3.62) 

and, consequently, G p(7c(A)7 c (A)). Therefore by (3.61) the Nevanlinna func- 
tion mp(') is uniformly strict. Moreover, in view of (3.62) and (3.22) one has 
(7 c (A)/i)(t) = v-p(t,X)h (h G it). Applying now Lemma 4.1, 3) from [18] to v-p(t, A) 
we arrive at the equality 

7*(A)/ = }vt(t,\)f(t)dt := lim/4(t, X)f(t)dt, f = f{t) G fl, 
o n\b o 

which implies that 

b f] 

7c( A )7c(pt) = fvp(t,X)vp(t,fi)dt := s - lim / v^(t, X)v v (t, /j,) dt. (3.63) 

Vtb 

Next, in view of (2.59) and (3.50) the second equality in (3.60) can be written as 
a(A) = (NS ■ ft) (~ PH p^ (X) ) Pi(A) - 5 (A)M_(A))~ 1 = 

{N?P H n - 7V *P ff nM_(A))(5 1 (A) - 5 (A)M_(A))- 1 . 

Therefore the operator function a(X) defined by (3.60) can be represented in the 
form (3.51). Combining this assertion with (3.59), (3.61) and (3.63) we obtain the 
identity (3.52) and the inequality (3.53). Moreover (3.52) and the equality (2.11) 
yield (3.54). 

Finally, the equality (3.55) is immediate from (3.58) and the block representation 
N' = (JVjJ 0) : 9 6 L -> K. □ 
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Corollary 3.15. Let the assumptions (a) of Theorem 3.11 be satisfied. Then the 
following statements are equivalent: 

(i) the characteristic matrix fi T (-) is a uniformly strict Nevanlinna function; 

(ii) the operator N = (Nq N±) (3.1) isomorphically maps H n © H n onto fC. 

If in addition dimH < oo, then the statement (i) is equivalent to the following 
one: 

(Hi) the operator Lq has maximal deficiency indices u + (Lq) = u^(Lq) = 2ndimH , 
H' = H'i =: H' (i.e., II = {H n © H' , Tq, T\} is a decomposing boundary triplet for 
L), dimH' = ndimH and the collection V can be represented as the holomorphic 
Nevanlinna pair (c.f Remark 24, 2)) C(X) = (C (A) Ci(A)), A G C \ R, 

C (A) = {N C' (X)) : H n ®H' -> K, d(A) = (N C[(\)) : H n ®W -)■ K, (3.64) 

where dim/C = 2ndimH and the operator N = (Nq N±) : H n © H n — > /C is an 
isomorphism. 

Proof. It follows from (3.55) that the Nevanlinna function Sl r (-) is uniformly strict 
if and only if L = {0}. Moreover by (3.48) one has 6^ = {0} KerN(= KeriV') = 
{0}. This yields the equivalence (i) <3> (ii). 

Next assume that dimH < oo and prove the equivalence (ii) (Hi). If G p(N), 
then dim/C = dim(H n © H n ) = 2ndimH and by (3.10) n_(L ) = n + (L ) = 
2n dimH. This and the second relation in (2.35) imply that dim%i = dim 'Mo = 
2n dimH and hence U = U x =: U. Therefore U' Q = H[ and n = {H n ®W, T , 
is a decomposing boundary triplet for L. Moreover by (2.15) the Hilbert spaces 
K © K/j in (3.2)-(3.5) satisfy the equalities dim(^ © JCj) = dimH = 2n dimH = 

dim/C. Hence JC'j = {0}, j G {0,1} and the equalities (3.2)-(3.5) take the form 
(3.64), which yields the implication (ii) => (Hi). The inverse implication (in) =>■ (ii) 
is obvious. Thus in the case dim H < oo the equivalences (i) <^ (ii) <^4> (Hi) hold. □ 

Remark 3.16. 1) It follows from Corollary 3.15 that in the case dimH < oo and 
n_(Lo) < 2n dimH the characteristic matrix f2 r (-) corresponding to the boundary 
operators (3.2)-(3.5) is not uniformly strict Nevanlinna function. In particular, by 
Proposition 3.2 this statement holds for each canonical characteristic matrix corre- 
sponding to the constant Nevanlinna collection (2.10). 

2) Let V G TR{H , Hi} be the collection (3.2)-(3.5) with K = H n , = H'j, j G 
{0,1} and C (A) = I Ho , d(X) = ni: n , D = P 1 and D x = Hl . Then the 
corresponding m-function m-p (-) coincides with the operator function m(-) defined 
by (2.39) and (2.40). Note in this connection that the statements of Theorem 3.11 
and Proposition 3.14 for m(X)(= m-p (X)) were obtained in our paper [17]. 

3.4. m-function and a characteristic matrix as the Weyl functions. In this 
subsection we show that a canonical m-function m-p(-) is the Weyl function of some 
symmetric extension A G ExtL , while a canonical characteristic matrix fi T (-) is 
the Weyl function of the minimal operator Lq (the last statement holds under some 
additional assumptions) . 
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Proposition 3.17. Assume that II = {"H,ro,ri} is a decomposing boundary triplet 
(2.32) for L (with U = H n © W ) and V = {C , d} G TR°(H) is an operator pair 
defined by (3.7) with H' = H[ =: W. Moreover Ze£ X,- G j G {0,1} 6e 

operators such that the operator 

X = : ft © ft -»• /C © /C (3.65) 

satisfies the relations X* JjqX = Ju and G p(AT) (suc/i operators Xq and X\ exist, 
because {(Co, — Ci); /C} is a selfadjoint operator pair). Suppose also that 

X =(* 01 * 02 ) :ft«ffift' X 1= (^ n * 12 ) : ft" © ft' -> t © £' 

(3.66) 

are iae block matrix representations ofXj, j G {0,1} and 




Co := f cf 2 ] :ft'^/Cffi/C'©/C, C[ := \ (" y , \ : H' ^ K K' K ( 3.67) 

Then: 1) the operator A := L \ T>{A) defined by the decomposing boundary con- 
ditions 

V{A) = {yeV: y W(0) = y^(0) = 0, C r o2 / - C^y = 0} (3.68) 

is a closed symmetric extension of Lq; 

2) the adjoint A* of A is defined by the boundary condition 

V(A*) = {yeV: C' m T y - C' 12 T' iy = 0}; (3.69) 

3) the maps fj : V(A*) ->■ IC, j G {0, 1} given by 

toy = N yW (0) + N iy W (o) + C 01 r y - C' u T' iy , (3.70) 

f lV = X 01 yM(0) + X u yW(0) + X 02 I> - X 12 T' iy , y G P(i*) (3.71) 

form a boundary triplet II = {/C,Io,Ii} /or A*; 

4) the corresponding ^ -field and Weyl function (2.25) for II are 

(7(A)h)(t) =vp(t,\)h, helC, AeC\f (3.72) 

M(A) = m P (A) + £>, D = D*e[IC}, AeC\R. (3.73) 

Proof According to [5] the operators 

f = C r - Ciri, f 1 = X T -X 1 T 1 (3.74) 

form a boundary triplet II = {/C © AT', To, Ti} for L and the 7-field for II is 

7(A) = 7(A)(0) -CiM(A))- 1 , AGC\E, (3.75) 
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where 7(-) and M(-) are the 7-field and the Weyl function for II respectively. More- 
over by (3.7), (3.66) and (2.32) the equalities (3.74) can be written as 

Toy = {N y {2) (0) + N iy ^ (0) + C' 01 V y - C' n T' iy , C' Q2 T' Q y - C[ 2 T' iy } (3.76) 

f xV = {X 01 y {2) (0) + (0) + X 02 T' y - X 12 T' iy , (3.77) 

X 032 / (2) (0) + X 13y W (0) + X 04 F' y - X 1A V 1 y}, y£V 

Applying Proposition 4.1 from [5] to the triplet II one obtains the following asser- 
tions: 

(i) the equality T>(A) = {y € T> : T$y = Pgtiy = 0} defines asymmetric extension 
A e Ext Lo ; 

(ii) the adjoint A* of A is given by V(A*) = {y G V : Pk^oV = 0}; 

(iii) the operators fj : V(A*) ->■ JC, j G {0, 1} given by 

f y = roy, t iy = P t f iy , yeV(A*) (3.78) 

form a boundary triplet II = {tC, To, Fx} for A* and the 7-field for II is 

7(A) = 7(A) r t = 7 (A)(Co - CW(A))- 1 \ K. (3.79) 

Next we show that the operator A and the triplet II satisfy the statement l)-4) of 
the proposition. 

First observe that (3.69) is immediate from the assertion (ii) and the equality 

(3.76) . Next, (3.76), (3.77) and the assertion (i) yield the equivalence 

' AW 2) (0) + iViy (1) (0) + C 01 T' y - C'^y = 
y G V(A) I C' G2 T' y - C[ 2 T[y = . (3.80) 

X oiy M(0) + X llV W(0) + X 02 T' y - X 12 T' iy = 

Let T>' 2 be the set of all functions y £ T> finite at the point b. According to [17] 
r' \ V' 2 = F[ \ V 2 = and in view of (3.69) V 2 C V(A*). This and the Lagrange's 
identity (2.30) imply that y (1) (0) = y (2) (0) = for all y € V{A). Combining these 
equalities with (3.80) and taking (3.67) into account we arrive at (3.68). 

The statement 3) of the proposition follows from (3.78) and the equalities (3.76), 

(3.77) . Moreover combining (3.79) with (2.38) and (3.22) one obtains the equality 
(3.72) for 7(A). Finally to prove (3.73) note that the Weyl function M(-) for ft 
satisfies the identity [4] 

M(n) -M*(A) = (jji- A)f(A)7(/z), /i,AeC\R. (3.81) 

Moreover in view of (3.79) 7(A) coincides with the operator function 7 C (A) defined 
by (3.62). Therefore the equality (3.63) holds with 7(A) in place of 7 C (A) and by 
(3.54) 

mpfji) -m£(A) = (n- A) 7 *(A) 7 (/i), fi,X e C\R. (3.82) 
Now comparing (3.81) and (3.82) we arrive at the relation (3.73). □ 
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Corollary 3.18. Assume that II = {H n (B H' ,To,T±} is a decomposing boundary 
triplet for L, N = (N$ Aq) is an operator pair (3.1) such that G p(N), N' is the 
operator (3.48), V = {C ,Ci} G TR°(H) is the operator pair given by (c. f. (3.64)) 

C = (N C'o) :H n (BH'^JC, d = (Aq C[) : H n © %' -)■ £ (3.83) 

anc? 

X =((v r ° ?\ /"v 1 ~?\V(tf n ©^0©(tf n ©^)^£©£ 
\l A oi A 02j (,— -mi -^12j/ 

zs i/ie operator satisfying the relations X*J^X = and G p(X). Moreover 

let T (-) 6e i/ie canonical characteristic matrix corresponding to r = {(Co, Ci); AC}. 
T/ien i/te operators 

r^y = {-y (2) (0),y (1) (0)} + tv'"'^!^ - A^c^y (g e tf n ) 

(3.84) 

ify = iV'*(X iy( 2 )(0) + Xny«(0) + X 02 r y - X 12 riy) (g H n © ff"), y£D 

(3.85) 

form a boundary triplet {H n H n , Tq , if} /or L i/ie corresponding Weyl func- 
tion 

M Q (X) = n T (X) + D, D = D* e [H n © fP 1 ]. (3.86) 

Proof. Comparing (3.7) with (3.83) one obtains K! = {0} and hence C 02 = C 12 = 0. 
Therefore the extensions (3.69) and (3.68) take the form A* = L, A = Lq and by 
Proposition 3.17 the operators (3.70) and (3.71) form the boundary triplet II = 
{/C, To, Ti} for L with the Weyl function (3.73). Next, according to Proposition 3.13 
in [5] the collection {H n © # n ,lf ,lf } with Tp 1 = N'^fo and if = iV'*fi is a 
boundary triplet for L and the corresponding Weyl function is 

Mq(X) = N'*M(X)N' (3.87) 

Now the equalities (3.84) and (3.85) are implied by (3.70), (3.71) and the relation 

N'-\Noy^(0) + N iy ^(0)) = N'' 1 N' '{-y™ (0) , yW (0)} = {-y^(O), y«(0)}. 

Moreover since G p(N')(& G p(N)), it follows from (3.48) that 6 L = {0} and by 
(3.55), (3.56) one has 

fl T (X) = n (A) = N'*m v (X)N + C, C = C* e[H n ® H n ]. 

Combining this equality with (3.73) and (3.87) one obtains the relation (3.86) for 
M n (A). □ 

Remark 3.19. It follows from Corollary 3.15 that in the case dimH < oo the con- 
ditions of Corollary 3.18 are necessary (and, by the statement of this corollary, 
sufficient) for the canonical characteristic matrix ft T (-) be the Weyl function of the 
operator Lq. 
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4. Spectral functions of differential operators 

4.1. The space L2(£;%). Let H be a separable Hilbert space. 

Definition 4.1. A nondecreasing operator function £ : R — > [H] is called a distri- 
bution if it is strongly left continuous and satisfies the equality S(0) = 0. 

Let X : R — > [H] be a distribution and let /(•), g(-) be vector functions denned 
on the segment [a,/3] with values in H. Consider the Riemann-Stieltjes integral [1] 

r /3 n 

/ (d£(t)/(t),0(t))= lim V((S(t fc )-S(t fc -i))/(6),^fc)), (4-1) 

where 7r = {a = to < *i < ' ' ' < t n = (3} is a partition of [a, /3], ^ G [ifc-i, *fc] and 
^ is the diameter of n. As is known (see for instance [13]) in the case dimV. = oo 
there exist a distribution £(•) and continuous functions /(•) and <?(•) for which the 
integral (4.1) does not exist. At the same time holomorphy of /(•) and g(-) on the 
segment [a,/3] is a sufficient condition for existence of such an integral [23]. 

Definition 4.2. A function / : [a, (3) — > % will be called piecewise holomorphic if 
there is a partition a = to < t\ < ■ ■ ■ < t n = /3 such that each restriction / [ [tk-i, tfc) 
admits a holomorphic continuation fk(-) on some interval £fc) D [ifc-i,£fc]. 

A function / : R — >■ H will be called piecewise holomorphic if it is so on each finite 
half-interval [a,/3). 

It follows from Definition 4.2 that a piecewise holomorphic function is strongly 
right continuous. 

Let S : R [H] be a distribution and let /, g : [a, (3) — » T~L be a pair of piecewise 
holomorphic functions. It is clear that there exists a partition of [a, f3] satisfying 
the conditions of Definition 4.2 for both functions /(•) and g(-). By using such a 
partition introduce the integral 

( (dZ(t)f(t),g(t)) = (dV(t)fk(t),9k(t))- (4-2) 

Note that for a pair of continuous functions /, g : [a, 0\ — > % piecewise holomorphic 
on [a, (3) there exists the integral (4.1) which coincides with that of (4.2). 

For a given distribution S : R — > [H] denote by Hol(E,T-L) the set of all piecewise 
holomorphic functions / : R — > % such that 

/ (dE(*)/(*),/(*)):= lim / (dE(t)/(t),/(t))<cx>. 

One can easily prove that for each pair f,g€ Hol(T,,T-L) there exists the integral 

(/,<?W,tt) = / (^S(i)/(i), 5 (t)) := lim / (dS(i)/(i), 5 (i)). (4.3) 

This implies that Hol(T,,T-L) is a linear space with the semi-definite scalar product 
(4.3). 
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Next recall the definition of the space ^(E; H) as it was given in the book [1]. 

A function / : R — > H is called finite-dimensional if there is a subspace Hf C H 
such that dimHf < oo and f(t) G Hf, tel. For a given distribution £ : R — >■ 
[H] denote by Cqq(H) the linear space of all strongly continuous finite-dimensional 
functions / : R — > H with compact support supp f. Clearly the equality 



(/,0)l 2 (E;*)= (dE(t)f(t),g(t)):= (dE(t)f(t),g(t)), f, 9 eC o(H) (4.4) 



with [a,/3] D (supp f U suppg) defines the semi-definite scalar product on Cqq(H). 
The completion of Cqq(H) with respect to this product is a semi-Hilbert space 
L 2 (E;H). The quotient of L 2 (E;H) over the kernel {/ € L 2 (E;H) : (/,/)l 2 (e ; H) = 
0} is the Hilbert space L 2 (E;H). 

Denote by Hol (E,H) the set of all strongly continuous, piecewise holomorphic 
and finite dimensional functions / : R — > % with a compact support. It is clear that 
HoIq(E,H) = Hoi (Ei, H) n Coo(%) and consequently HoIq(E,H) is a linear manifold 
both in Hol(E,H) and Cqq(H). Moreover the semiscalar products (4.3) and (4.4) 
coincide on HoIq(E,H). 

By using the Taylor expansions of the function / G Hol(E,H) one can prove the 
following proposition. 

Proposition 4.3. The set HoIq(E,H) is a dense linear manifold both in Hol(E,H) 
and Cqo(H), which implies that the closure of Hol(E,H) coincides with L2(E;H). 
In other words the semi-Hilbert space L2(E;T-l) can be considered as the completion 



Remark 4.4. In connection with Proposition 4.3 note that the intrinsic functional 
description of the spaces L2(E; T~L) and Lz(E; H) in the case dim H < oo was obtained 
in [11]. Moreover in the case dim'H = oo the description of these spaces in terms of 
the direct integrals of Hilbert spaces can be found in the recent paper [13]. 

4.2. Spectral functions. Let II = {Ho © Hi, Tq, Fx} be a decomposing D-triplet 
(2.32) for L and let r = {r + , t_} G R(Hq, H\) be a Nevanlinna collection defined by 
(2.13) and (2.44), (2.45). For this collection consider the boundary problem (2.46)- 
(2.48). According to Remark 2.12 this problem defines the spectral function F T (t) 
of the operator Lq. 

Next assume that K, is a separable Hilbert space and <^(-,A) : A — > [K,,H\ is an 
operator solution of the equation (2.29) with the constant initial data £>(0, A) = 
V?o(£ [fc,H 2n ]), A G C, such that G p(<po)- Denote by Sjo the set of all functions 
/ G $)(= Li2(A;H)) with suppf C [0,/?] (/3 < b depends on /) and consider the 
Fourier transform gj : R — > K of a function / G S)q given by 





ofHol(E,H). 




(4.5) 



Definition 4.5. A distribution £(■) = E T)ip () : M — > [/C] is called a spectral function 
of the boundary problem (2.46)-(2.48) corresponding to the solution ip(, A) if for each 
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function / G Sjo the Fourier transform (4.5) satisfies the equality 

((F T ((3)-F T (a))f,f)s,= [ (d^(s)g f (s),g f (s)), [a,/3)cR. (4.6) 

Note that the integral in the right hand part of (4.6) exists, because the function 
<7/(-) is holomorphic on R. Moreover by (4.6) <?/(•) G Hol(Y, T)ip ,K,) and the following 
Parseval equality holds 

(II/IIS=) f\\fm 2 H dt= [ (d^(s)g f (s),g f (s))(=\\g f \\l 2{ ^ /G% 

This implies that the linear operator V : Sj — > L2(S T)¥ ,;/C) defined on the dense 
linear manifold f)o C -fj by (F/)(s) = gf(s) is an isometry. 

Definition 4.6. A spectral function S TjV ,(-) is called orthogonal if VSj = L>2(T lT ^; /C) 
or equivalently if the set of all Fourier transforms {<//(•) : / € -f)o} is dense in 

Theorem 4.7. Let H be a Hilbert space with dimH = 2n ■ dimH, let W G [H, H 2n ] 
be an isomorphism and let Yjy(-,A) : A — > [H,H] be an operator solution of the 
equation (2.29) with the initial data Yyy(0, A) = W, A € C. Then for each collection 
t G i?(%0)%i) there exists the unique spectral function T* Tj w '■ K — >■ [i?] o/ i/te 
boundary problem (2.46) -(2.48) corresponding to the solution Y\y(-, A). This function 
is defined by the equality 

1 [ s ~ s 

T, tW (s) = s — lim w — lim — / Im Q T w (a + i e) da, (4.7) 

8^+0 e^+0TTj_ s 

where £l T ,w : C \ R — >■ [if] is a Nevanlinna operator function given by 

n T)W (\) = w~ 1 n T (\)w~ 1 *, agc\r. (4.8) 

Moreover the spectral function £ T; w(-) is orthogonal if and only if r G R q {Hq,Hi). 

One can prove Theorem 4.7 by using the Stieltjes -Livsic formula [12, 23] in the 
same way as in [24] (the scalar case dimH = 1) and [3] (the case dimH < oo). 
Moreover in the scalar case other methods of the proof can be found in the books 
[20, 7]. 

Theorem 4.8. Assume that under the conditions of Theorem ^.7S Ti ^(-) is a spec- 
tral function of the boundary problem (2.46)-(2.48) and V : f) —■ Li^ T yv\ H) is the 
corresponding isometry given by the Fourier transform (4.5) with ip(t,s) = Yw(t,s). 
Moreover, let Hol°(H) be a linear manifold of all piecewise holomorphic functions 
g : R — >■ H with compact support. Then Hol°(H) is dense in L^i^r^w'iH) and 

(V*g)(t) = [ Y w (t, s) dX T:W (s)g(s), g = g(s) G Hol°(H), (4.9) 

JR 
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where V* : L2(£ t ,vk; H) —■$) is the adjoint operator and the integral is understood 
as the sum of integrals similarly to (4.2). In particular formula (4.9) implies that 
the inverse Fourier transform is 

f(t)= ( Y w (t,s)dX T , w (s)g f (s). (4.10) 
Jr 

In the case dimH < oo the proof of Theorem 4.8 can be found in [20, 7, 24]. In 
the case dimH = oo a somewhat weaker result (only the inverse transform (4.10)) is 
contained in [3]. In this connection note that in the case dimH = oo the piecewise 
holomorphy of a function g(-) is essential, because otherwise the integral in (4.9) 
may not exist. 

Our next goal is to obtain a description of all spectral functions £ T) w(-) immedi- 
ately in terms of a boundary parameter r. Namely, using the block representations 
(2.39) and (2.40) of the Weyl functions M±(-) introduce the operator functions 
n T0 (X)(e [H 2n ]), S + (X) (G [H ,H 2n ]) and S_(z)(€ [HuH 2 *]) by setting 

n TQ (X)=( m 1 ^ ~^ H ") :H n ®H n ^H n ®H n , AgC\M (4.11) 

y-^iHn o j 

S+(X) = ~ M ^ X A :H n ®H' ^H n eH n , AG C+ (4.12) 

S-(z) = ~ M2 Q ^ : H n © n[ — >■ H n © H n , z G C_. (4.13) 

Note that Q T0 (X) is a characteristic matrix corresponding to the collection To = 
{t +,t -} G R(Ho,Hi) with r 0+ = {0} ffi^i(G C(Wo,«i))- 

Theorem 4.9. Let £/te assumptions of Theorem 4-7 be satisfied and let Q TOt w(X)(£ 
[H]), Sw,+{X)(& [Ho,H]) an d Sv^-(-z)(G [7ii,.ff]) be the operator functions given 
by 

n T{hW (\) = w~ 1 n T0 (x)w u , agc\m ; 

S Wt +(\) = W^S+iX), X G C+; S w -(z) = W- x S-{z), z G C_. 

Then for each collection r = {r + ,r_} G R(Tio,T-Li) the equality 

n T MX) = n T0 ,w(X) - S Wt+ (X)(r + (X) + M + (A))- 1 5^_(A), A G C+ (4.14) 

together with (4.7) defines a (unique) spectral function S T) v^(-) of the boundary prob- 
lem (2.46)-(2.48) corresponding to the solution Y\y(-,X). Moreover a spectral func- 
tion T, Ti w(-) is orthogonal if and only if r G R°('Ho,'Hi). 

Proof. According to [19] for each collection r = {r + ,r_} G R{Hq,T-L\) the corre- 
sponding characteristic matrix £l T (-) is given by 

Q T (X) = n n) (X) - S+(A)(r+(A) + M+(A))- 1 SI(A), A G C+ (4.15) 

This and Theorem 4.7 yield the desired statement. □ 
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4.3. Minimal spectral functions. We start the subsection with the following 
lemma which is immediate from Theorem 4.7. 

Lemma 4.10. Let S Tj¥ , : R — > [/C] be a spectral function of the boundary problem 
(2.46) -(2.48), corresponding to the solution (p(t,\)(£ \K,,H\) of the equation (2.29) 
(see Definition 4-5). Assume also that H D JC, JC 1 - = HQfC and Y\y{-, A)(G [H, H}) 
is a solution of (2.29) satisfying the conditions of Theorem ^.7 and the equality 
Yyy(t, A) I" JC = (p(t,X) (such a solution exists because G p((p(0, X))). Then the 
(unique) spectral function of the boundary problem (2.46) -(2.48) corresponding to 
Y W (-,X) ^ 

X TjW (s) = ^ : JC © JC 1 - -»■ JC © JC ± , (4.16) 

which implies that the spectral function £ t ,uj is unique. 

Conversely if a spectral function £ T) w is of the form (4.16), then T, Tjip (s) is a 
spectral function corresponding to <£>(•, A). 

Now combining Theorems 4.7, 4.8 with Lemma 4.10 and taking the equality (3.40) 
into account one derives the following theorem. 

Theorem 4.11. Let N = (No N±) be an admissible operator pair (3.1) and let 
<fN(t, A)(G [JC,H]) be the operator solution of the equation (2.29) with the initial data 
(3.27). Then: 1) for each collection V = {C(-), £>(■)} G Ti?{H ,Hi} of holomorphic 
pairs (3.2) -(3.5) there exists a unique spectral function Sp jv : K — > [JC] of the 
boundary problem (3.11)-(3.15) corresponding to yjv(-, A). This function is given by 

i r^ 5 

S-p /v(-s) = s — lim w; — lim — / Im m-p(a + i e) da, (4.17) 

<5^+0 e^+OTT J_ s 

where m-p(X) is the m-function corresponding to the boundary problem (3.11)-(3.15). 
Moreover, the spectral function E^jv is orthogonal if and only ifV G TR°{Ho, Hi}. 

2) let S-p ; jv(-) 6e a spectral function and let V : S) — > Z^C^^n; JC) be an isometry 
given by the Fourier transform (4.5) mi/i f(t,s) = ipN(t,s). Then 

(V*g)(t) = [ <p N (t, s) dZ P , N (s)g(s), g = g(s) G i7o/°(/C). 

In particular the inverse Fourier transform is 

f(t)= / (p N (t,s)dE-p, N (s)gf(s). 

In the next theorem we give a parameterization of all spectral functions S-p i jy(-) 
in terms of a boundary parameter V G Ti?{%o>%i}- 

Theorem 4.12. Let t/ie assumptions of Theorem 4- H be satisfied , let N be the 
operator (3.49) and let T Nfi : C \ R -> [/C], rjv,+ : C+ -> [W ,£] and T^,. : C_ -> 
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[Hi,K] be the operator functions defined by 

T Nfi (X) = N*n T{) (X)N, A€C\R; 

Tn,+ (X) = N*S+(X), AgC+; T N -(z) = N*S-(z), z G C_. 

Then for each collection V G TR{'Hq,'H\} given by (3.2)-(3.5) the equality 

m v (X) = T Nfi (X)+T N , + (X)(C (X) - C 1 (A)M + (A))- 1 C 1 (A)T^_(A), A G C+ 

(4-18) 

together with (4.17) defines a (unique) spectral function X-p^O) of the boundary 
problem (3.11)-(3.15) corresponding to (p^. Moreover a spectral function Sp i jy(-) is 
orthogonal if and only ifV G TR°{%o, %\}. 

Proof. Let V G TiJj/Ho^i} be defined by (3.2)-(3.5) and let r+(A)(G C(^ ,^i)) 
be the corresponding linear relation (2.13). Then by (4.15), (3.57) and the equality 

-(r+(A) + M + {X))- 1 = (C (A) - C 1 (A)M+(A))- 1 C 1 (A), A G C+ 

the m-function m-p(X) can be represented via (4.18). This together with Theorem 
4.11 yield the required statement. □ 

Next for a given collection r = {r+, r_} G R{Uq, rii) defined by (2.13) and (2.44), 
(2.45) consider the corresponding boundary problem (2.46)-(2.48). Denote by d m i n 
the minimal value of dim AC for the set of all spectral functions S T)¥ , : M — > [AC] of this 
boundary problem (recall that according to Definition 4.5 each T, T ^ corresponds to 
some operator solution i^(i,A)(G [K,,H]) of the equation (2.29)). 

Definition 4.13. A spectral function £(•) = T, Tj(p (-) : R — >■ [AC] will be called 
minimal if dim AC = d m i n . 

In the following theorem we give a description of all minimal spectral functions 
of the "triangular" boundary problem (3.11)-(3.15). 

Theorem 4.14. Let II = {Hq@T-Li^ To, Ti} be a decomposing D-triplet (2.32) for L, 
let V = {C(-), D(-)} G TR{Hq : 'Hi} be a collection of holomorphic pairs (3.2)-(3.5) 
and let (3.11) -(3.15) be the corresponding boundary problem. Then: 

1) d m in = dim AC and the set of all minimal spectral functions S m j n (-) is given by 

Zmin(s) = X*Z P:N ( S )X, (4.19) 

where E-p ) jv(s) is the (minimal) spectral function defined in Theorem J^.ll and X is 
an automorphism of the space AC. Moreover, the minimal spectral function S m j n (s) 
given by (4.19) corresponds to the operator solution (p m i n (t,X) := (fN(t, A)X _1 * of 
the equation (2.29). 

2) if dim H = oo, then d m i n {= dim AC) = oo. 

Proof. 1) Let S T)¥ , : M — > [AC] be a spectral function of the problem (3.11)-(3.15) 
corresponding to the solution ip(t, A)(g [AC, H]) with ip(0, A) = y?o(£ H 2n ]). Since 
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G p(tfo), there are a Hilbert space K, 1 - and an operator i/jq G [/C -1 - , H 2n ] such that 
the operator W = (tpo tpo) is an isomorphism of the space H := JC © /C 1 - onto ff 2n . 

Let n T) v^(A) be the operator function (4.8) and let E T; jy(-) be the spectral function 
(4.7) corresponding to the solution Y\y(-, A) (see Theorem 4.7). It follows from (2.61) 
that s— lim f2 r w(w)/y = 0. This and the integral representation of the Nevanlinna 

y— >oo ' 

function fi r ,w(A) [2, 12] yield 

Ker Jm n T ,w(A) = (h e H : Z TtW (s)h = 0, s G R}, A G C \ R. (4.20) 

Moreover by Lemma 4.10 the function E T) jy(s) satisfies (4.16), which in view of 
(4.20) gives the inclusion K, 1 C Ker ImQ, Tt wW, A G C \ R. Now, letting H := 
H Ker Im£l T ,w(X) one obtains dimi?o < dim/C. 

Next assume that W G [/C © /C" 1 , H 2n ] is the isomorphism (3.35) and fi Tj w/(A) is 
the operator function (3.38). It follows from (4.8) that there exists an isomorphism 
C G [K © K- L ,H] such that Cl TjW i(\) = C*VL T)W (\)C. Moreover, by the block 
representation (3.40) one has Ker Im£l T w(X) = K, 1 - . Hence Ker Im f2 Tj w(\) = 
C1C 1 - and consequently /C = C*Hq. Therefore dim/C = dimi^o < dim/C, which 
yields the equality d m i n = dim/C. 

To prove the relation (4.19) note that for each automorphism X G [K] this relation 
defines the minimal spectral function E m j„(s) = S rjl)5m4n (s), corresponding to the 
solution <pmin(t, A) := (p N (t, X)X~ 1 * . Conversely, let T, min (s) = Y, T ^ min (s) be a 
minimal spectral function corresponding to the solution ^ m j n (M)(£ Since 
G p(£>(0, A)) fl p(ipn(0, A)), there exists an automorphism X G [/C] such that 
<Pmin(t,\) = ifN(t, A)X _1 * and hence the distribution E(s) := X*Sp i jy(s)X is a 
spectral function corresponding to (p m in- Since by Lemma 4.10 such a function is 
unique, it follows that E m j„(s) = E(s) = X*Ep ] Ar(s)X. 

The statement 2) is implied by the statement 1) and the inequality (3.10) □ 

Finally by using the above results we can estimate the spectral multiplicity of an 
exit space extension A D Lq. Namely, the following corollary is valid. 

Corollary 4.15. Let the assumptions of Theorem 4-14 be satisfied and let R-p(X) = 
Psj(A — A) -1 \ S) be a generalized resolvent generated by the boundary problem (3.11)- 
(3.15). Then the spectral multiplicity of the extension A does nod exceed d m i n (= 
dim /C) . 

Proof. Let E = E-p^ : K [fC] be a spectral function defined in Theorem 4.11 and 
let x'( s ) be a bounded linear map in Hol(E,K.) given for all s G R by 

(X'(s)f)(a) = X (-oo,s)(<r)m, f = m e Hol(Z,lC) 

(here X(-oo,s)(") i s the indicator of the interval (— oo,s)). It is easily seen that the 
map x'( s ) admits the continuous extension x( s ) £ [-^2(S;/C)] (s G R) such that %(•) 
is an orthogonal spectral function (resolution of identity) in L2(E;/C). 
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Next assume that V G [fi, /C)] is an isometry given by the Fourier transform 

(4.5) with ip = ifN and let C := VS), C = span{£, x( s )£ : s G M}. As is known 
the subspace C reduces the spectral function x(s) and the equality x(s) = x(s) \ £■ 
defines the minimal orthogonal spectral function x{s) in C (actually one can prove 
that C = L2(X;/C)). Moreover, the relation (4.6) yields 

Fp(t) = V* X (t) V = V*(P c x(t) \ C)V, t G R, (4.21) 

where F-p{t) = P^E{t) \ fj and E(t) is the orthogonal spectral function of A. It 
follows from (4.21) that the spectral functions F-p(t) and Pcx{t) \ £> are unitary 
equivalent and, consequently, so are the (minimal) orthogonal spectral functions 
E(t) and xit)- This and the fact that x{t) is a part of x(t) imply that the spectral 
multiplicity of E(t) does not exceed the spectral multiplicity of xif)-, which in turn 
does not exceed dim/C. This proves the required statement. □ 

Remark 4.16. It follows from Proposition 3.2 that in the case n& + < oo (in par- 
ticular, dim if < oo) the statements of Theorem 4.14 and Corollary 4.15 can be 
naturally extended to the boundary problems (2.46)-(2.48) generated by a quasi- 
constant Nevanlinna collection {C(-), D(-)}. 
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